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The Method of Least Squares 


8.5.3 The Method of Least Squares 

Here, we use a different method to estimate / 3 q and ( 3 \ . This method will result in the same 
estimates as before; however, it is based on a different idea. Suppose that we have data points 
(xi,yi), (# 2 , 3 / 2 ), • * % (x n ,y n ). Consider the model 

y = Po +( 3 ix. 


The errors (residuals) are given by 

Ci = Vi ~ Vi = Vi ~ P 0 - P\X. 


The sum of the squared errors is given by 

n n 

9(Po,Pi) = = ~ ~ P lXi ) 2 - ( 8 - 7 ) 

i=1 i=1 

A A 

To find the best fit for the data, we find the values of / 3q and /3\ such that g{J3 (), (3\ ) is 
minimized. This can be done by taking partial derivatives with respect to Pq and (3\ , and 
setting them to zero. We obtain 

n 

= y'2(-l)(j/ i - ft - PiXi) = 0, (8.8) 

r\ n 

■wr = y 2 2 (-%i)(yi -Po - Pm) = 0 . ( 8 . 9 ) 

dPi 

A A 

By solving the above equations, we obtain the same values of /3q and /3i as before 

A 

Pi 

A 

Po 




J xx 


= y - fax, 


where 
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n 

Sxx = - X) 2 , 

i =1 

n 

s xy = -x)(Vi ~ V)- 

i =1 

This method is called the method of least squares, and for this reason, we call the above values 

A A 

of /3q and f3\ the least squares estimates of /3q and f3\ . 
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